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ASS2RAOT 


A Linear Delta Modulation sj^stea has been simulated. 

The signals used as input are a flat band-limited Gaussian 
signal and a B.C!-shs,ped Gaussian signal. Thereafter a 
Differential Pulse Code Modxilation sjrstem has been simulated. 
Herein Predictive Quantization systems using linear predictors 
have been studied with multi-bit qu.antizers having 4,8 and 16 
levels. A predictive system with a Gauss -fferkov input has als 
been studied. The signal to noise ratios obtained are best 
for a Gauss-Mar kov input. Pina.lly an attempt has been made 
at bit rate reduction of the transmitted signal. 

Results obtained compare favourably with results obtained 
earlier. However, the results for bit rate reduction do not 
give any scope for incorporating in a practical system. 



CHAPTER 1 


INTRODUCTION 

In & communication system the effect of interference 
in the transmission path can he reduced considerably by 
quantizing the signal into a finite number of levels, 
assigning a code to each of these levels and then transmi- 
tting these code words in the form of a two level pulse 
stream. This is the well known n bit Pulse Code Modulation 
(PCM) system. Even if a noiseless transmission is assumed 
the performance of such systems is limited mainly due to 
error added to the signal on reception. This error manifests 
itself in the form of what is known as quantization noise. 

For an acceptable performance 7 or 8 bit PCM is necessary 
for speech and television transmission. This naturally 
constrains the nmber of signals that can be transmitted 
throu^ a given channel. 

The signal to noise ratio for a PCM system is given by [9] 
SNR(dB) = 6n - 7.2, 

where n is the number of bits being used for coding. The 
above formula assumes that the quantizer is aligned such 
that the mazimum range of the input signal is between -A<3 and 
44cr where cr^ is the input variance of the signal. It 
has been seen that for a zero mean Gaussian input signal' 



2 


samples ■will fall outside this range with a probability 
less than 10“'^. 

Speech sampled at Nyquist rate exhibits a significant 
correlation between adjacent samples. As a consequence 
of this the variance of the difference between two consecutive 
samples is less than the variance of the speech signal itself. 
Thus we have 

B{e|) = B[(X^ - 
= BCX^] + 

= Ei:x|] [2(1 - 

where XLj. and ^represent the samples at time t and (t-1) 

respectively, e^ represents the difference signal. 

Now if is greater than 0.5 has a smaller variance 
than X. It is therefore simpler to quantize e^ instead of X. 
An integrator is used to reconstruct X from quantized values 
of e^. This technique of quantizing the difference signal is 
called Differential Pulse Code Modulation (DPOM). This 
technique permits emplo 3 nnent of a smaller value of n and 
thereby reduces bandwidth. Considering a subjective evalxia— 
tion it is found that for the same bit rate DPCM is superior 


to PCM. 
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Oversampling a signal increases tlie adjacent sample 
correlation and we can have a relatively simple technique of 
quantization which uses 1 hit. This 1 hit version of DPCM 
is called. Delta Modulation (DM). 

Figure 1(a) depicts a DM system schematically. The 
handlimited input signal is sampled at a rate f^ which is 
much higher than the Nyquist rate. At every sample, the 
sign h„ of the difference between X. and the latest approxi- 
mation to it generated, this is m-ultiplied by a step 

in the direction of h^. Finally the high frequency wave- 
form Y is low pass filtered to the original signal bandwidth. 

The basic equations characterizing DM are given as tinder 
bt = Sga(X^ - T^_^) 

^t ~ ^t— 1 

2. DELTA MODULATION 

The block schematic of a Delta Modulation codec is shown 
in Fig. 1(b). The waveform p(t) at the output of the delta 
modulator consists of pulses of duration t seconds placed 
T seconds apart (T^t) having amplitude +^5 . volts. These 
pulses occur at clock times ^3 = ^ where fg is considerably 
greater than the Nyquist rate. 

Figure 1(c) depicts the output waveform of a delta 
modulator. The difference between X(t) and Y(t) where y(t) 
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is the reconstructed signal constitutes the error signal e(t). 
This error signal is quantized to linits +.a volts depending 
upon its sign. The output of the quantizer is sampled every 
T seconds to produce L(t) pulses. 

If e(t) is greater than or equal to zero at a clock 
instant a positive pulse will be produced at the output of the 
encoder. When Y(t) becomes greater than X(t), e(t) will become 
less than zero and a negative pulse will thus emanate from the 
encoder. In short the encoder attempts to reduce the error 
wave form when an input signal ic proa ant., by producing 
positive and negative pulses. 

Figure 1(c) also illustrates the two types of quantizing 
errors in Delta Modulation - slope overload distortion and 
granular noise. Slope overload is said to occur when the 
step size A is too small to follow a steep segment of the 
input waveform. Granularity refers to the situation where 
the staircase function Y(t) hunts around a relatively flat 
segment of the input function X(t), with a step size that is 
too large relative to the local slope characteristics of the 
input . 

The decoder consists of an integrator and a filter. 
Assuming additive channel noise to be zero the L(t) is 
recovered and integrated to yield Y('c) which is identical 
to the feedback to the error point in the encoder. As this 
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Y(t) differs from the input signal X(t) by a relatively small 
error signal e(t)^ the output of the integrator in the 
decoder is thus a good reproduction of the original signal 
X(t), and has some quantization noise added to it. This can 
be reduced by either increasing the sampling frequency or 
using a multi level quantizer instead of the two level quanti- 
zer described herein. The step like nature of Y(t) is removed 
by passing the signal through a filter whose pass band is the 
same as message band. ¥hen no input is applied to the 
encoder it is said to be in an idling state and the output of 
the delta modulator is 101010 .... 

The effect of additive channel noise is to introduce 
accumulative error in the demodulated signal. This is due to 
the integrator in the feedback path and can be reduced by 
putting a leaky integrator in the feedback path. This will 
however limit the slope and amplitude. A better approximation 
of the input signal is possible by using a double integration 
in the feedback pa,th. The output wave form is smoother than 
in the case of a single integrator. low pass filtering 
further smoothers the signal and it is a better reproduction 
of the input signal. The disadvantage of a double integrator 
is that it is slow to follow fast changes of the slope of 
the message signal. 
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Consider a sinusoidal input given by 


X(t) = Sin 2 % (1.1) 

X’(t)= 271 Cos 271 f^t (1.2) 

Max slope = E^ 27i; f » (1.3) 

m HI 

for a step length X and a sampling fz’equency we have 

Slope of X(t) = Ef (1.4) 

s 

Thus for no slope overload 

\ ( 1 - 5 ^ 

Let E^^ represent the maximum amplitude which does not 
overload. 


Therefore E = ICf „ /27if„ (1.6) 

niiii o in 

In the idling state the wave form T(t) at the output of 
the integrator is sq.uare with peak to peak value of X, To 
disturb idling input sinusoid must have an amplitude 

This thus gives us the dynamic range (DR) of the 
systems as under 


DR 



(1.7) 


The quantization noiso is due to the error signal 
e(t). Asstiming that the spectral density S^(i) si this 
error signal is flat over the message band we have quantiza- 
tion noise N related by the relation 
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= E - - — 

<1 q f ’ 
^ s 


( 1 . 8 ) 


where is a constant of proportionality and is of the 
order of 1/3 and f^ is the cut off frequency of the low pass 
filter. 


The signal to quantization noise ratio is defined as 

2 2 
the input signal power (S ) to the decoded noise power 

Si 

Tor a sinusoid the maximum input power is given by 


o ^ 
q 2 mm 
S - 


1 

2 12% f. 


m 




(1.9) 


combining 1.8 and 1.9 we have signal to quantization noise 
ratio given by 


SEE 


_ 1 r s 

" W~ 12% f 
q m 


]2 z 


'B 


8K%^ 

. q me 


( 1 . 10 ) 


For a double integrator in the feedback path the signal 
to noise ratio is given by 

^5 


SNR 


8 ’'^ 4 4 


( 1 . 11 ) 



8 


The increase in SUR is 9 dB and 15 dB per octave in 
the case of the single integrator and double integrator 
respectively. 

3. DIBFEREBTIAL PULSE CODE i-IODULiTIOU 

This technique as brought out earlier emanates from 
PCM and diffeisto the extent that instead of quantizing the 
original signal we quantize a difference signal which is 
generated from the original signal and an estimate of this 
signal. The estimate may be generated by incorporating a 
predictor in the feedback path of a DPCM system. Such systems 
will be referred to as the Predictive Quantizing systems, 

3.1 Predictive Quantizing Systems 

A schematic diagram of a predictive quantizing system 
is shown in Pig. 2. The difference between the input signal 
and the predicted signal, which is generated from the past 
history of the signal, is fed as input to a multi-level 
quantizer. The predictor used in the feedback path may be 
a linear or a non-linear type. The theory of linear predictors 
is discussed in the succeeding paragraphs. 

3.2 Linear Prediction 

Consider a stationary signal x(t) with zero mean and 
variance cr^ being sampled at instants ...... 

The sample values at these instants are given by 
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Tile linear estimate of a sample Xq at the next sampling 
instant is given hy 

^0 ~ ^ 1^1 **" ^" 2^2 ^ n ^’ 

where a's are real niimbers. The difference or error signal 
is given by 

A 

®0 “ ^0 ~ ^0 

A block diagram showing such a predictor is given in Pig. 3(a). 
The D's represent the delays-D^ implying a unit delay, D2 two 
delays and indicating n delays, 

A 

The best estimate of Xq will be that value of Xq which 
gives minimum expected value of the squared error. To deter- 
mine the values of a’s which satisfy this condition we take 
partial derivative of E[(2 ;q - with respect to each 

one of the a's and set it equal to zero. 

^vE[(xq - Xq)^ 3e[(xq - (a2^Xj_ + a2X2 + + 

% sl^ ” a ^^ 

= -2E[XqX. - (a3_x^ + a2:JC2 + **•* ^ 
i = 1, 2, .... n 


Equating this to zero to get a minimum we have 
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E[(xq - (a3_x^ + a2X2 + .... + ^ ^ (1.12) 

(1.13) 



Tills gives rise to a set of n simultaneous equations iiaving 
n unknowns in a^, i = lj2, .... n, which can be determined if 
the covariances R. . are known. Rewriting (1.15) in matrix form 
we have 



(1.16) 
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Considering the fo.ct that x(t) is a stationary process we 
have 


hd = ®di 


^(ij) ^(i+k(3+k)), k = 0,1>2, 


Hence (1.16) can be rewritten as under 


n 


(1.17) 


r 

r- 



V*! 

r 1 

o 

H 



^01 ^02 

^03 

^On-1 


ai 

^02 . 


^01 


^02 

^On-2 


o» 2 

• " 

• 

= 

• 

m 




z 

m 

« 







- 

• 







m 

^On ■ 


: \)n-l 

^0n-.2 


... 


■ a 

n 

t— — 


: — 




i J 


(1.18) 


¥e can rewrite (1.18) in notational form as 

--1 ^ 


opt 


i 




where 


^ 2 

f cr^ 

^01 

•p 

*4^ 

02 

On-l ' 

j ^01 

^2 

p 

R 


01 

On-2 


^On-1 ^On-2 


-I 
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and 



Tiius hy knowing the covariances we can determine the unknowns 
a^ *s» i ~ •••• n, 

A predictive quantizing system is shown in Fig. 3(1). 
The sampler converts the analogue input x(t) into its digital 
form. Let he the output sequence of the sampler at the 
ith instant. The output of the predictor at this instant is 
and is given by the sum of ^<3. the (i-l)th output of 

the quantizer. The error e^ which constitutes the input to 
the quantizer is given by the difference between Xj^ and 
The quaint izer has N discrete levels. The output of the 
quantizer is thus the error signal e^^ and some quantization 
noise q^. On the receive end the input is (e^ + q^). The 
predictor as on the transmitter end forms a part of the feed- 
back loop and produces the linear estimate which is mixed 

with the input signal to yield (x^^ + q^). This is then passed 
through a low pass filter to yield y(t) which is a replica 
of x(t) with some quantization noise added. 
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The signal to quantization noise ratio fur such a system 
is obtained from the following [7j ; 

S]m(dB) = -4.35 + 6n + 10 log , 

% 

where n represents the discrete levels that the quantizer takes 
2 

and O' is the mean square value of the error signal. 

4. ADAPTIVE DELTA MODUIATIOE 

A more flexible means of matching quantizer step size 
to input signal variance is the use of step size adaption 
based on quantizer memory. This involves modifying the step 
size by a factor depending on the knowledge of the previous 
quantizer output. In its simplest form the scheme operates 
with a one bit memory. A simple algorithm using such a one 
bit memory for automatic step size correction is as follows [6] 


i^li 

II 

H 

H 

I 

if 

^i 

= ^i-i 


= X 

H 

1 

if 

^i 

^ ^i-.i 

where 

1 and 


and 


is the ith output of the 

quantizer. 

In other words 

in 

case 

the ith bit output of the 


quantizer as ■ given by b^ is the same as the (i— l)th bit the 
magnitude of the step size k^ increases by a factor 
In contrast the step size decreases by a factor 1^2 in case 
bi and b. _3_ 


are different 
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Adaptive Delta Modulation systems have not been consi- 
dered during the course of this study. 

5. SCOPE OP woke: 

In the work reported here digital computer studies of 
Linear Delta Modulation and Predictive Quantization systems 
have been made. Specif ico.lly the following simulation studies 
have been carried out : 

(a) Simulation of a DM system with a band limited Gaussian 
signal as input having ; 

(i) Uniform power spectrum, 

(ii) RC integrated spectrum. 

(b) Simulation of a DM system with a Gauss-ferkov signal 
as input . 

(c) Simulation of Predictive Quantizing systems using 
2,4,8 and 16 levels gf quantization. 

(d) An attempt has been made at reducing the transmitted 
bit rates by not transmitting the encoder output bit 
stream directly but by coding it further in another 
encoder. 




FIG. 1(a) BLOCK DIAGRAM OF A DM SYSTEM 


OliAMTfZFR 



MODULATOR SYSTEM 
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OHiLPTER 2 

PSEUDO RANDOM NUMBERS AND TYPES OP INPUT SIGNALS 

Discrete dynamic systems can either be deterministic 
or stochastic. Atleast one variable in a stochastic system 
is given by a probability function. There is thus a need 
of a source which can generate random variables so that such 
systems can be simulated. Though the method of generation 
is deterministic there is still a randomness about the 
numbers generated and as such they are called pseudo random 
numbers. The process being deterministic in itself consti- 
tutes an advantage as we can use the same set of niombers 
under different conditions while analyzing systems. 

These random numbers are of immense use in the simula- 
tion of communication systems, as the input to such systems 
can be represented by a probability function. The system 
study undertaken needs three different types of input signals, 
viz. Gaussian with uniform power spectral density, Gaussian 
with an RC-spectriim and a Gauss-Markov process. 

Gaussian signals with uniform power spectral density 
are used extensively for the simulation of data and PDM 
signals. A signal having an RO-spectrum is characterized 
with a constant spectral density upto a certain point and 
then it rolls of having a constant negative slope. Such 
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signals are used to simulate speech and television signals. 

It is, however, felt that speech signals are "better simulated 
using a Gauss-Markov process. Bach sample in such a signal 
has a Gaussian distri'bution hut the process is Markov in 
so far as dependency of each sample is concerned upon the 
previous samples. 

2. GBBBRATIOK OP lEPUT 3IGMIS 

•The "basic source for generating all the desired input 
signals is a source generating \miformly distributed random 
numbers. Existing librarjr subroutines have been modified 
and used to generate uniformly distributed random variables 
in the interval (0,1). The feature of the subroutines used 
is that the seed for generating the uniform variates is not 
a part of the subroutine but is external to it. This brings 
about some cunount of flexibility and the subroutine can be 
initialized to conduct more than one set of simulations at any 
one time. The constant Cq also called the multiplier and the 
seed " 2 ^ for five different sets of uniformly distributed 
random variables are given below. 

Uq 189277 186285 186293 186301 186309 

Xq 11750920161 27594084237 10796931217 17669802561 560227513 

2.1 Generation of Plat Band Limited Gaussian Signals 

Gaussian variates with uniform power spectral density 
are obtained by using the Box Maeller Transformation given as 
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und er : 


S = SQRT(-2 logg RNl) x Oos ( 2 x u z RN2), (2.1) 

where RRl and IIU2 are two uniform random nnnbers in the range 

(0,1), S is the standard normal distribution. Por a sample 

2 

Z from n.ny normal distribution with mean ii and variance cr 
we have 

A = oS + [1 (2,2) 


2.2 Generation of RO-Shaped Gaussian Signals 


For generating a RO-spectrum the flat Gaussian signal, 
band limited to the frequency (0, f^) is pa,ssed through a low= 
pass RC filter. The one sided power spectrum of the output 
is [4] 


S^(f) = — Il f -- - - '- ' 

tan ■^(2'n:f-/a) 


(27i;f)^ + 


0<f <f 


(2.3) 


where we assume a mean square value of unity and a equal to 
1/RC. This RC— spectrum is relatively flat from f = 0 to a 
corner frequency of f = {aj2%) at which it rolls off to 
assume a slope of -6 dB per octave upto the cut off frequency 
of fg. 

2.3 Generation of Gauss-Markov Signals 

Gauss-Markov can be of different order. This is 
dependent on the past history coig^idered while generating 
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each sample. Por this study Gfauss-Markov process of the 
first order only has been considered. A schematic diagram 
to generate such a signal is given in Pig. 4. 

Mathematically we can represent the generation as 
Xr = ^ Vl ^ ^r » ^ 

where is a Gaussian random variable with zero mean and 
variance o and an adjacent sample correlation of 0 close to 

JL 

1 (say C ^0.9). is the input Gaussian process with 

2 

zero mean and varicance cTq such that [6] 

4 =0^(1- 02) (2.5) 

3. SIMUIATIOU OP DIGITAL PIITERS 

The Delta Modulation systems simulated need a low pass 
filter so as to produce a discrete output from a discrete 
input. Digital filtering may be looked upon as a numerical 
algorithm representi3ag a discrete system with both input and 
output described by time series or number sequences. Thus if 
X- and y^ denote the input and output signals respecti- 
vely, then the filter algorithm takes the explicit form 

^i = ^i^i ^i-1 ^i-1 ^ ^ 

+ ^2 ^ 1-2 

where the index i may run from —'•ao to Cw or from 0 to cjo 
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depending upon -whether the signals are one sided or two 
sided and a's and h's are real numbers. 

Consider a numerical signal 'f’ its Z-transform 
is defined by 

n=0 

where a is a complex variable, fhe operation of taking 
Z-transform of a signal is denoted by 

= Z(f) 

The Z-transform is a linear operation and as such 

Z(a.f + b.g + c.h) = a.Z(f) + b.Z(h) + c.Z(g) 

where a,b and c are real numbers. 

Consider the signal 'f and another signal related 
to 'f’ as follows 

= 0 for i4 k 

i'f . = fi-k 

X 

k^ is called the shifted version of 'f- The Z-transform 
of such a shifted signal is given by 

Z(k^) = Z(f) 

The product of Z-transforms 
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F(z“^) = G-(2~^) H(z~^) 


is represented in the time domain as the discrete convolu- 
tion 


n 

° ‘‘“-3 


(2.7) 


Using standard results of functional analysis it can be 
shown that the input and output of a linear filter are 
related through a convolution 

i 

V*-' 


r=0 




( 2 . 8 ) 


where the sequence 'h' is independent of x and y and is 
called the impulse response. Taking Z-transform. of both 
sides of (2.8) we have 

Y(z“^) = H(z~^) 2 (z”^) (2,9) 

where X(z'"^), I(z“^) and H(z“^) are the Z -transforms of the 
input signal, output signal and transfer function of the 
filter characterized by (2.8) and (2.9). ThD convolution 
in (2.7) can be expressed as a recurssive formula whicih would 
yield the result given in (2.6). 


Standard Z-transform method is used to obtain the 
filter algorithm. The numerical low-pass filter used for 
the simulation studies is available as a programme package. 
The parameters are as follows : 

QMS - Sampling frequency 
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OMl 


lower cut off frequency 



TR 


Transition ratio 

_ lower 

cut off 

frequency 


Upper 

cut off 

"frequency 

R1 

- 

Pass band ripple 




R2 


Stop bond ripple 





4. SimiATIOlf RESULTS 


Tiiro'ugliout the study 12,000 samples have been considered. 

Beyond this the samples no longer remain random. One set of 

Gaussian variates generated and used for the study ::cro analyzed 

for mean, variance and correlation. The results are as under : 

N 

Mean = ^ x- = 0.023 

N it:l ^ 


IT 

1 ; 2 

Variance = ^ 2' ^i 

i=l 

Correlation coefficients 


= 1.029 
R 


where m is an integer with which correlation is to be 
determined. The results for correlation upto the 10th sample 
are as under 


ml 234 5 6 7 8 9 10 

r^OjDl^ -.008 0.00 0.05 0.01? 0.001 0.009 0.006 0.010 0.001 
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Tile Gaussi-on variates are passed tJirougjb. a low-pass 
digital filter so as to obtain a band limited process. The 
sampling frequenc 5 r (OMS) is fixed at 2 and the cut off fre- 
quency (OMl) is varied to obtain various sampling frequency 
to cut off frequency ratios. The pass band power for 
different cut off frequencies is irieasured. The para.meters of 
the filter are 


TR = 

0.98 

R1 = 

0.05 

R2 = 0.01 

OMS = 

2 



and the 

power 

measured is 

indicated 

in the 

table 

below. 


OMl 

0.1 

0.2 

0.3 

0-.4 0.5 

0,6 

0.7 

0.8 0.9 

1.0 ; 

Power 

in 

pass 

band 

0.099 

0.197 

0.293 

0.397 0.498 

0.597 

0.689 

0.789 0.873 

0.929 



I 

[ 
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CHAPTER 3 


SII’OTIATIOI OP A DELTA MODUL/ITIOH SYSTEM 


In the simulation of the Delta Modulation system we have 
assumed that there is no over loading and no additive channel 
noise. The only noise in the system is the quantization noise. 
The input message signal has a normalized maximum frequency 
of unity and it is a zero mean process with variance equal to 
unity. Before proceeding with the simulation we have to 
design the step size. This has been done by Goodman [3] for a 
continuous process x(t). The no overload condition is 
expressed as the probability of slope of the input signal 
exceeding the maximum slope of the reconstructed signal being 
very small. 


let S (f) be the power spectral density of the input 


process x(t). The mean square value of the signal is given by 

(3.1) 


a') 


s^^(f) df 


and the effective band width is given by 

JL 
2 


*8 = 


df 


df 

The root mean square slope of x(t) is 2ixfga^ and. 


(3.2) 


maximum slope of the reconstructed signal is Icfs where k 
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is tile step size of the delta modulation system. It has 
been shown that if 

kfs = 2-rtf (3.3) 

the probability of over load for a value of c= 4 is only 

6 X 10~^. 

The delta modulation system that has been simulated on 

the IBM 7044 system is depicted in Big. 5 . Pseudo random 

sequences are obtained according to the details in Section 2 

of Chapter 2. These sequences are thereafter filtered 

through a low pass digital filter whose design and parameter 

details are given in Section 3 of Chapter 2. The various 

Sampling frequencies for the system are simulated by altering 

the cut off frequency of the digital filter. Consider the 

sampling frequency to be M times the JTyquist rate. This is 

simulated by fixing the cut off frequency of the digital 

filter to 1/M. Thus the cut off frequency, of the digital 

filter at Fyquist rate is unity. The adder and delay element 

in the feedback loop around the quantizer constitutes an 

accumulator. The transfer function of the feedback loop is 

—ST 

D/l-D where D is the unit delay operator g and represents 
a delay of one sample interval T. Since 

= D + + 
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the signal being fedback is simply the sum of all previously 
transmitted s.amples. It is also identical to the decoded 
signal of the receiver and represents the signal value predi- 
cted for the next sample time. The difference between the 
input signal value x- and this predicted signal y. , is q.uan— 
tized by a two level quantizer and transmitted through a dis- 
crete channel. 

The noise n^^ is obtained after low pass filtering the 
difference between x^^ and y^. This constitutes the quantiza- 
tion noise. 


The effective band width (f^) for an RG-spectrum input 
signal has been worked out by substituting (2.3) in (3.2) 
and taking the limits. The simplified expression is 


fe = 



^ "t/ 0,3^1 


, where A = a/ 2-^ 


In carrying out the simulation using the RO-spectrum as the 
input the system remains essentially the same as in Pig. 5 
with only an RG network following the low pass digital 
filter. The output of the digital filter is normalised so 
as to present a unity variance at the input of the RC net- 
work. 


The mean square signal to mean square noise ratio for 


the system is given by 
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N 

1 1 ^2 

SHR(i.B) = 10 logjQ ~ 1' ' — |r » where K is the nimber of 

""" 

samples taken for the simulation. 

The various studies conducted using this delta modula- 
tion model with both the Ga,ussian and fiC-spectirum inputs are 
as follows ; 

(a) Variation of signal to noise ratio with the variation 
of sampling frequency 

(b) Variation of signal to noise ratio with variation of 
input variance 

(c) Variation of signal to noise ratio with the variation 
of step size of the delta modulator, 

2. SIMUMTIOIT 01 PREDICTIVE QUART IZAT 101 SYSTEM - 

The system simulated is depicted in Eig. 3(b) with the 
predictor in the feedback loop being the same as in Fig. 3(a). 
The input is an RO-spectrum signal. The gains given by the 
matrix (1.18) require prior knowledge of correlation coeffi- 
cients. These have been determined at various sampling 
frequencies as a,lso with different samples. Detailed values 
obtained are in Table 1. Thereafter the gains a^, 
i =1,2, 10 have been calculated. These are given 

in Table 2 for different sampling rates for i=l,2 and 3. 

The difference between input and output signals, assuming 

an errorless "'transmission ut digits 'Is the quantization 
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SP/M 

1 

2 

3 

4 

5 

2 

0.88617181 

0.78380060 

0.69561201 

0.61837169 

0.55203526 

4 

0.97029400 

0.90354672 

0. 04086397 

0.79570761 

0.75417227 

8 

0.99359221 

0.97380032 

0.94523875 

0.91293104 

0.88134523 

16 

0.99869221 

0.99392824 

0.98624202 

0.97602578 

0.96378019 

32 

0.99959394 

0.99856295 

0.99682868 

0.99441512 

0.99134760 

64 

1.00009738 

0.99990770 

0.99956909 

0.99908365 

0.99845111 


SP/M 

6 

7 

8 

9 

10 

2 

0.49046009 

0.43647905 

0.58719029 

0.34255737 

0.30573286 

4 

0.70770171 

0.66403474 

0.62860159 

0.59530659 

0.55960187 

8 

0.85314724 

0.82879478 

0.80703569 

0.78597314 

0.76416609 

16 

0.95006610 

0.93546224 

0.92051557 

0.90569908 

0.89138559 

32 

0.98767132 

0w98342961 

0.97867535 

0.97346402 

0.96785601 

64 

0.99767601 

0.99675887 

0.99570365 

0.99451429 

0.99319233 


Table 1 
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SP 



^2 


2 

0.88617318 




0.89236897 

- 0.00699164 



0.89244611 

- 0.01683643 

0.01103219 

4 

0.97029458 




1.59901036 

- 0.64796333 



2.07224902 

- 1.81579672 

0.73034723 

8 

0.99359334 




2.03806298 

- 1.05120441 



- 1.91195510 

6.60704368 

- 3.75761012 

16 . 

0.99869256 




2.32033654 

- 1.32337427 



1.21657299 

0.61190563 

- 0.83404991 

32 

0.99959456 




1.77105940 

- 0.77177778 



1.25021278 

0.42344068 

- 0.67485664 

64 

1.00010220 


«> 


- 0.42857350 

1.42852972 



3.37339276 

0.28777871 

- 2.66153180 


Table 2 
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error. Since the digital transmission rate of any S 3 rsteia is 
finite, one has to use a q^uantizer which sorts the input into 
a fiiiite number of ranges, U. For a given U, the system is 
described by specifying the end points of the N input 
ranges, and an output level y^^ corresponding to each input 
range. One would like to choose IT for the corresponding 

Xj^s such that the distortion D is minimum. It has been 
shown by Max [8] that D = klT"”^ where k is a constant. 

At the outset a single predictor has been used in the 
feedback path and using a two level quantizer. The results 
obtained are not much different to those of an LDM system. 
This is because the gain a^ is almost unity and as such the 
predictor is nothing but a leaky integrator, large number of 
predictors in the feedback path ■using a two level quantizer 
give rise to instability in the system. 

Thereafter, the quantizer was progressively replaced 
by a 4,8 a.-n d 16 level quantizer and the signal to noise ratio 
measured. Increasing the predictive path to 2 and thereafter 
to 3 gave no appreciable change in the results. Values of 
Xjj.s and y^^s used are given in Table 3 . 

Another predictive system simulated uses the Gauss- 
Markov input. The system diagram is given in Fig. 6. The 
output of the Delta Modulator for a Gauss-Markov input as 
given by (2.4) is depicted by 
b^ = Sgn 



Level 





0.0 

0.4528 

0.9816 

1,510 

0.0 

0.2541 

0.5006 

0.7560 

1.050 

1.344 

1.748 

2.152 

0.0 

0.1284 

0.2582 

0.3881 

0.5224 

0.6568 

0.7996 

0.9424 

1.099 

1.256 

1.437 

1.618 

1.844 

2.069 

2.401 

2.733 


Table 


3 
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K = IC 

^ ( 5 . 3 ) 

where b^ is the DM-bit, ’a' is the predictive path gain and 
IC che step length. Using a one bit quantizer we have the 
difference signal given by 

= Zr - a.Y^_3_ (3.4) 

The quantization error is the difference between 
the output and the input 

®r = ^r “ ?r 

Using (2.4), (3.4) and (3.5) the quantizer input can 
be written as 


= (c + S^) - a(Z,.i + 

= + (o - a) - a (3.6) 

2 

If ^opt ^represents the optimum step length, the 

variance of the quantizer input and the variance which 
gives the minimum quantization error we have [6] 


%t = ^‘"q 
(T? = <rJ/M 


(3.7) 


Assuming the quantizer input, Qj^as also the input signal,!^ 
to have a Gaussian distribution we have 
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L = f2pir * 0.80 

M = (1 - 2 / 71 )"^-^.. 2.78 

"Si 


The variance of can be approximated by squaring (3.6), 
and taking the expected value, neglecting the contribution due 
to cross products we thus get variance of Q^. "'■S n cum of 

squares ; 


cfq = <7^ + (c - a)^ cT^ + a^cr^ 
y. ^ X e 

From (2.5), (3-7) we can rewrite (3.8) as under 

^x _ 1 - a^/M 
a 1 - 2ac + a 


(3.8) 


(3.9) 


To determine the optimum gain 'a' we take derivative of 
( 3 . 9 ) and equated it to zero. The optimal predictor gain 
is given as under ; 


^-opt “ 



r 

il + M 

1 

1 

1 

1 

j 


V - V ‘ 


2c 


M^2 


.. M 


1/2 


( 3 . 10 ) 


To begin with the gain 'a' of the predictive path is 
kept constant and equal to ' c' and the signal to noise ratio 
measured. Thereafter the predictive path gain is varied 
through the optimal predictor gain as calculated by (3.10) and 
the signal to noise ratio measured till the system becomes 
unstable. 
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3. DATA COMPRESSIOlf AM) SIMUIATIOIT OE AU ADAPTIVE DELTA 
MODULATION SYSTEM 

A Linear Delia Modulaiion sysiein using an. RC~ sped rum 
as iiie inpui signal is simulaied ai a samplin..^ freQuency of 
16. The ouipui hii pattern emanating from the (juantiser is 
considered as a stream of 4 hit words. Their distribution 
gives an indication as to the redundancy or near redundancy 
of including some words in the data to be transmitted. Accor- 
dingly these are eliminated resulting in a reduction from 16 to 
8 combinations, thereby reducing the word length of transmi- 
tted data from 4 to 3 bits. At the receive oiid the data 
was converted to 4 bits and the original message as transmi- 
tted was approximately reconstructed. The signal to noise 
ratio is again measured so as to have a qualitative assessment 
of the degradation in the system. The noise includes both 
quantization noise as also noise introduced due to data 
compression. The study presumes that no overloading occurs 
and the transmission channel losses are zero. 

The above process using the same system set up was 
repeated but the system was made adaptive in so far as its 
step length was concerned using the algorithm as given in 
Section 4 of Chapter 1. Sudi a system requires a knowledge 
of the previous bit output of the quantizer. The step length 
is either increased or decreased by a factor M depending on 
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whetlier the present bit is the same or different as compared 
to the previous bit. This -takes care of overload condition 
in the system, the step length being adaptive. The optimum 
value of M as suggested by Jayant |[6] is 1.1, Once again 
the^ signal to noise ratio of the system is determined. 

4. SIMUIATIOU fiESULTS 

(a) The input is first a Gaussian band limited signal with 
an uniform spectral density uniform over the band (0,1). The 
next input has an RO-spe ctrum. For various sampling frequen- 
cies the signal to noise ratio is determined. The results 
are tabulated below. 


Input /SF 2 

4 8 

16 

32 

64 

Uniform SNR(dB) -13.23 

-1.28 8.97 

18.26 

26.91 

34.76 

RC-spectrum -0.65 

SNR(dB) 

10.88 20.51 

29.11 

38.64 

48.16 


It is evident that the signal to noise ratio in case of 
the RO-spectrum is higher than in the case of the uniform 
spectrum signal input, however, the 9 dB increase per octave, 
as shown by O'Neal is maintained. These results have been 
represented on a graph in Fig. 7. 
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(b ) The Sampling freq.uency is fixed at 8 and the input 
variance is varied from -20 dB to +20 dE. The signal to 
noise ratios as measured are given below. 


Input variance(dB)“20.00 

-14.77 

-10.00 

-4.77 

0 

Uniform SUR (dB) -17.31 

-11.26 

-5.1 

2.63 

8.97 

RC“Spe ctrum SUR (dB) -4 . 18 

2.77 

8.39 

14.67 20.51 

Input variance +4.77 

10.00 

14.77 

20.00 


Uniform .SlTR(dB) 12.64 

9.29 

4 *.86 

2.55 


RO-spe ctrum 24.00 

SNR (dB ) 

17.97 

10.74 

6.29 


These results have been plotted in Rig. 8, 



(c) The sampling frequency 

and other parameters 

! are kept 


fixed and the step length varied. The 

signal 

to noise 


ratio for a sampling frequer 

Lcy of 32 are given below. 


Step length 

K/2 

K 2K 

4E 

8E 

Uniform SNR (dB) 7.58 

21.57 26. 

92 19.68 

10.99 

1.71 

RO-spe ctrum 17.75 

SNR(dB) 

34.95 38. 

64 30.90 

22.25 

13.78 
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The results for a uniform input have been shown plotted 
in Fig. 9 and those for an RC-spectrum in Fig. 10. 

(d) For a predictive delta modulation system the signal to 
noise ratio are measured with one stage of prediction using 
an RG-spectrum input. The results are given below. 

SF 2 4 8 16 32 64 

SnRCdB) -.84 11.07 20.53 29.49 38.36 47.24 


It will be observed that the above results are marginally 
different to those obtained using a delta modulator. This is 
because such a system has a predictive path gain almost equB.1 
to unity and as such it behaves like a delta . modulator having 
a leaky integrator in its feed back path. 

The results of a predictive system using higher levels 
of quantization are as under 

SF /Levels 

2 SM(dB) 

4 SM(dB) 


4 

8 

16 

11.65 

17.14 

22.72 

15.59 

20,06 

25.73 
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(e) The signal to noise ratio for a predictive system having 
a Gauss-Markov input gives the following signal to noise ratio. 


S;F 4 8 16 

SNR(dB) 14.91 23.38 31.96 

These results are plotted in Pig. 7. The predictive path 
gain has been kept equal to the gain used for generating the 
Gauss -tiarkov process. 

The signal to noise variations versus the predictive gain 
keeping the gain in the Gauss -Iferkov generation loop as con- 
stant are tabulated below. 


Gain 

0.0 

0.1 

0.2 

SEadB.) 

5.11 

5.37 

5.80 

Gain 

0.7 

0.8 

0.9 

SHR(dB) 

8.77 

11.18 

18.28 

Gain 

0.96 

0.97 

0.98 

SEIl(dB) 

23.30 

23.64 

23.82 


0.3 

0.4 

0.5 

0.6 

6.17 

6.58 

7.05 

7.69 

0.92 

0.93 

0.94 

0.95 

21.13 

21.84 

22.15 

22.96 


0.99 

23.50 


These results have been plotted in Pig. 11. 

(f ) The distribution of 4 bit binary words at the output of 
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the output of the delta modulator using 8 different sets of 
random number generators is given in Table 4. 

The signal to noise ration on data compression is 20.61 dB 
as a,gaiiis b 29»11 dB without any compression, sJords with a 
probability less than or eQ.ual to ,004 have not been transmitted, 

From Table 4 it is amply clear that the bit pattern for 
all the random number generators used is approximately the same. 
Hence only one random number generator was used for an Adaptive 
system. The distribution pattern was as under. 


Word 0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

Distr. 325 

130 

236 

25 

274 

221 

131 

125 

145 

146 

240 

Word 11 

12 

13 

14 

15 







Distr. 236 

25 

253 

129 

358 








As the distribution was found to be more or less -uniform 
no attempt has been made to compress the data. 



Total nimler ox' words = 3000 
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FIG. 5. DELTA MODULATION SYSTEM AS SIMULATED 



FIG. 6. DELTA MODULATION OF A FIRST ORDER 
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CHAPTER 4 
COHOLUSIOIT 

The simulation studies conducted have been aimed at 
studying Linear Delta Modulation and Predictive Quantization 
systems. The systems have been so designed that the noise 
at the receiver output is only due to quantization of the 
input. The transmission channel has been assiimed to be noise 
free. The results obtained conform favourably with the 
results obtained by others. 

The Linear Delta Modulation system has been studied 
with three different types of input signals, viz. a flat 
band-limited Gaussian signal, a RG-shaped Gaussian signal 
and a Gauss-Markov signal. Considering a sampling frequency 
of 16 the signal to noise ratios obtained are 18.26 dB, 

29.11 dB and 31.96 dB respectively. The system performance 
as indicated by the signal to noise ratios is best for a 
Gauss-Markov signal input, followed by a RC-shaped Gaussian 
input and poorest for a flat Gaussian signal. The increase 
of 9 dB per octave in signal to noise ratio is, however, 
maintained in all three cases. 

An interesting feature for Gauss -JIarkov signals is the 
manner in which optimum step length is calculated [6] and 
is different to the method suggested by Goodman [3]. The 
initial results assume the predictive path gain to be the 
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SGjae as the loop gain of the Gauss -Markov generator. later 
this path gain has been varied to show that there is an 
optimum value for which the signal to noise ratio is maximum . 

The Predictive Quantization system studied use a 

single predictor in the feedback path. The system has been 

studied for 2,4,8 and 16 levels of q.uantization. Uon uniform 

quantizers have been used in each case, and the quantizer 

characberistics were chosen [10] to give minimum mean-squared 

error in the output. A two level quantizer and a sampling 

frequency of 4 gave a signal to noise ratio of 10.88 dB whereas 

the same bit rate obtained by using a, sampling frequency of 

2 and a 4 level quantizer gave a signal to noise ratio of 

11.65 dB. The results are almost comparable. On the other 

hand a 16 level quantizer with a sampling frequency of 2 gave 

a signal to noise ratio of 22.72 dB whereas choosing the sane 

bit rate an 8 level quantizer with a sampling frequency of 

ratio 

4 gave a lower signal to noise2_of 20.06 dB. Higher levels 
of prediction did not yield any increase in the signal to 
noise ratio. 

Since both DM and DPOM methods are slope limited it is 
necessary that the behaviour of such systems using adaptive 
techniques should be studied in detail. Such techniques 
would ensure that the instantaneous slope variation of the 
input would be better reproduced in the outiDut, thereby 
reducing the slope overload noise. By using an optimum 
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algoritlim like tlie "type suggested by Jayaut [6j, as indicated 
in Section 4 of Chapter 1, it nay be possible to substantially 
reduce the overload noise. 

An adaptive system does add to the complexity of the 
circuitry vis^-a-vis a Linear Delta Modulation system but 
it does increase the dynamic range. 

The results for bit rate reduction do indicate that a 

reduction in the bit rate is possible but this is not very 

realistic from the point of view of actual systems. There is 

a decrease of 9 dB in the signal to noise ratio in reducing 

the transmitted bits from 4 to 5. The same signal to noise 

ratio can be achieved by reducing the sampling rate to half 

1 3 

but the ratio of bit rate reduction is ^ as against ^ in the 
case studied. 

Finally, it must be said that real signaJLs like speech 
and television can not truly be judged by the signal to noise 
power ratio measnrement alone. A subjective eva.luation is 
in fact more approioriate. It is possible to sample speech 
and code the sampled signal which is put on a magnetic tape,* 
like wise pictures can be scanned a,nd the scanned signal 
can be coded to generate a coded signal on magnetic tape. The 
magnetic tape so created is used as an input to the simulated 
linear Delta Moduln,tion or Predictive Quantization systems. 
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The output is obtained on a magnetic tape which is used 

to recreate the original signal which makes the subjective 
evaluation feasible. 
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